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Abstract. Bille and G0rtz (2011) recently introduced the problem of substring range counting, for 
which we are asked to store compactly a string 5 of n characters with integer labels in [0, u], such that 
f-^ later, given an interval [a, b] and a pattern P of length m, we can quickly count the occurrences of P 

^ whose first characters' labels are in [o, b]. They showed how to store S in 0{n log n/ log logn) space and 

answer queries in 0{m + log log m) time. We show that, if S is over an alphabet of size polylog(n), then 
we can achieve optimal linear space. Moreover, if u — npolylog(n), then we can also reduce the time 
I to 0{m). Our results give linear space and time bounds for position-restricted substring counting and 

the counting versions of indexing substrings with intervals, indexing substrings with gaps and aligned 
I— I pattern matching. 

q 

^ 1 Introduction 

^ Bille and G0rtz [T] recently introduced the problem of substring range reporting, for which 

^ we are asked to store compactly a string S' of n characters with integer labels in [0,u], such 

^ that later, given an interval [a, b] and a pattern P of length m, we can quickly report the 

^ occurrences of P whose first characters' labels are in [a,b]. They showed how to store S 

in 0{nlog^ n) space on a word RAM and answer queries in 0{m + t) time, where e is an 
CN arbitrary positive constant and t is the number of occurrences reported. We work in the word 

^ RAM model as well so, unless otherwise specified, throughout this paper we measure space 

T— I in words. They also showed that this gives the same space and time bounds for position- 

>- restricted substring search [12] , indexing substrings with intervals [5] and indexing substrings 

with gaps [9]. Their solution consists of a suffix tree, a data structure for 2-dimensional range 
^ reporting and several instances of a data structure for 1-dimensional range reporting. Calcu- 

lation shows that, if we replace the 1-dimensional instances by bitvectors, then they take only 
0{n) space. This does not improve the overall bound, however, because the 2-dimensional 
data structure still takes 0{n\og'^ n) space. Chien, Hon, Shah and Vitter [1] proved that, in 
the weaker pointer-machine model, any solution for position-restricted substring search with 
0(mpolylog(n) + t) query time must use i7(nlogn/(loglogn)^) space, even when the alpha- 
bet has constant size. By Bille and G0rtz' reduction, this lower bound holds for substring 
range search as well, even when the alphabet has constant size and u = n. 

In an updated version of their paper p], Bille and G0rtz introduced the related prob- 
lems of substring range counting, for which we are asked only to count the occurrences of 
P whose first characters' labels are in [a, 6], and substring range emptiness, for which we 



are asked whether there exist any such occurrences. For the counting problem, we could 
restrict our attention to intervals of the form [1,6], but we consider general intervals for con- 
sistency with Bille and G0rtz' paper. They gave a solution to the counting problem that uses 
0{n\ogn/ log log n) space and 0{m + log log u) query time, and a solution to the emptiness 
problem that uses 0(?7,loglog(n + u)) space and 0{m) query time. (Although they claimed 
to use 0{n\og\ogu) space for the emptiness problem, this seems to be under the assumption 
u > n.) They noted that solutions to the substring range counting and emptiness problems 
give the same space and time bounds for position-restricted substring counting and emptiness 
and the counting and emptiness versions of indexing substrings with intervals and indexing 
substrings with gaps. As before, each solution consists of a suffix tree, one data structure 
for 2-dimensional range queries and several instances of a data structure for 1-dimensional 
range queries. For range counting and range emptiness, however, there are fast linear-space 
solutions known, leaving open the possibility that simple modifications of their solutions 
give better bounds. Notice that, unless we restrict the labelling, linear space is optimal when 
logu = i7(logn). It makes no difference here, but by log we always mean log2. 

In this paper we show that, if 5* is over a polylogarithmic alphabet (i.e., of size polylog(n) = 
log'^*^^^ n) then we can reduce the space bound for substring range counting to 0{n) while still 
answering queries in 0{m + log log m) time. If m = npolylog(n) — as in position-restricted 
substring counting, indexing with intervals and indexing with gaps — then we can also re- 
duce the time bound to 0{m). (Notice linear time is unfortunately not necessarily optimal, 
as we need only 0{mlog\ogn/w) time to read P, where w = i7(log(n + u)) is the word 
size.) In this case, our bounds for substring range counting are strictly better than Bille 
and G0rtz' bounds even for substring range emptiness, which is a special case of counting. 
By Bille and G0rtz' arguments, our results give linear space and time bounds for position- 
restricted substring counting and the counting versions of indexing substrings with intervals 
and indexing substrings with gaps. We show they also imply linear space and time bounds 
for the counting version of aligned pattern matching [15j. 

It is not difficult to see that we generally cannot use both linear space and linear time 
when u is unrestricted: suppose that, given n elements from a universe of size u, we store 
them in an array and assign them as labels to the characters of a unary string; we can 
implement rank queries as substring range counting queries for patterns of length 1, and 
select queries as array accesses; it follows that, if we could answer substring range counting 
queries in 0{m) time, then we could answer predecessor queries in 0{1) time. On the other 
hand, although our own approach seemingly will not work, we see no obvious reason why it 
is impossible to use both linear space and linear time when, say, both u and the alphabet 
size are equal to n. We leave this as an open problem. 

2 Applications 

For position-restricted substring counting, we are asked to store S compactly such that, 
given a pattern P and an interval with 1 < i < j < n, we can quickly count the 
occurrences of P starting in S[i,j]. As Bille and G0rtz noted, to solve this problem via 
substring range counting, we simply assign each character of S" a label equal to its position 
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in S. For the counting version of the shghtly more comphcated problem of indexing substrings 
with intervals, we are asked to store 5* and a set vr of intervals in [1, n] such that, given P 
and [i,j], we can quickly count the occurrences of P that start in [i,j] and in one of the 
intervals in tt. Bille and G0rtz noted that, to solve this problem, we change to the labels 
of all characters not in any interval in vr. 

For the counting version of index substrings with gaps, we are given an integer d and 
asked to store 5* compactly such that, given two patterns Pi and P2 of total length m, we can 
quickly count the positions in 5* where there are occurrences of Pi followed by d characters 
followed by occurrences of P2. Solving this problem via substring range counting was Bille 
and G0rtz' most sophisticated reduction. We sort the reversed prefixes of S into lexicographic 
order and assign the rank of S'[l.i] reversed as the label of S[i + d + 1]. Given Pi and P2, 
we compute the interval containing the lexicographic ranks of reversed prefixes that start 
with Pi reversed, then count the occurrences of P2 whose first characters' labels are in that 
interval. 

For aligned pattern matching, we are given two strings Si and 5*2 of total length n and 
asked to store them compactly such that later, given two patterns Pi and P2 of total length 
m, we can quickly find all the locations where Pi occurs in Si and P2 occurs in S2 in the same 
position. Thankachan [T3] noted that this problem can be solved directly via 2-dimensional 
range reporting, using 0{nlog^ n) space and (9(loglogn + t) time, where t is the number of 
such locations. He then showed how to store 5*1 and 5*2 in compressed form, but this solution 
takes Olm + log^"*"*^ n + t) time when the lengths of Pi and P2 are both in i7(log^'''^ n), and 



It is straightforward to reduce aligned pattern matching to substring range reporting: we 
simply assign each character Si[i] in 5*1 the lexicographic rank of the ith suffix of 5*2 (i.e., 
the sequence of labels is the suffix array of S'2). To answer a query, we first find the interval 
containing the lexicographic ranks of the suffixes of 5*2 that start with P2. We then search 
for occurrences of Pi in Si whose first characters' labels are in that interval. This reduction 
also works for the counting versions of these problems. More generally, we might be given a 
library of strings and a function / mapping positions to positions, and asked to count the 
times Pi occurs in a position i in the library and P2 occurs in position f{i). In this general 
case 0{n) space is optimal, even just to store the labels. 

Since we use only labels in [l,n] in any of these reductions, it follows by our bounds for 
substring range counting that if S is over a polylogarithmic alphabet, then we can solve all 
these counting problems using linear space and time, i.e., 0{n) space and 0(171) time. 

Finally, we note that Bille and G0rtz' result can be modified to very slightly speed up 
some grammar-based self-indexes. For example, Gagie, Gawrychowski, Karkkainen, Nekrich 
and Puglisi [8] recently showed how, given a balanced straight-line program for a string 
S of length n whose LZ77 parse consists of z phrases, we can add 0(2 log log words 
such that later, given a pattern P of length m, we can find all t occurrences of P in S* in 
0{m? + (m + t) log log n) time. Following Kreft and Navarro [TT] and previous authors, they 
use two Patricia trees [13] and a data structure for 2-dimensional range reporting to find the 
occurrences of P that cross phrase boundaries in the parse. Without going into too much 
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detail, they split P into a prefix and suffix at every positive position, then search for the 
reversed prefix in one Patricia tree and the suffix in the other, then use range reporting 
to determine which phrases are preceded by the the prefix and followed by the suffix. If 
we store data structures for 1-dimensional range reporting (or bitvectors) at the uppermost 
log log n levels of one of the Patricia trees — much like Bille and G0rtz do in one suffix 
tree for indexing substrings with gaps — then the time bound for searching shrinks (albeit 
very slightly) to 0{m^ + tloglogn), while the space bound is not affected. If S is over a 
polylogarithmic alphabet and we are interested only in determining whether P occurs in S 
at all, but not where nor how often, then we can use our results from this paper to reduce 
the time bound further, to C(m^), while simultaneously reducing the added space to 0{z) 
words. We will give full details in the full version of that paper. 

Theorem 1. Given a balanced straight-line program for a string S of length n whose LZll 
parse consists of z phrases, we can all 0{z\og\ogz) words such that, given a pattern P of 
length m, we can find all t occurrences of P in S in 0{m'^ + t log log n) time. 

3 Preliminaries 

The suffix tree for 5* is the compacted trie storing the suffixes of 5, so each edge is associated 
with a substring of 5*, called its label. A child query at a node v takes a character c and 
returns a pointer to the unique child of v that is reached by an edge whose label starts with 
c. The concatenation of edge labels on the path from the root to v is denoted str5'(f). We 
say f's string depth is |str5(t')|. An interval query at v returns the interval of lexicographic 
ranks of the suffixes of S that start with str5(f). If v is the shallowest node such that P is 
a prefix of sti siy), then we call v the locus of P. We use suffix trees in essentially the same 
way as Bille and G0rtz do, so we refer the reader to their paper for more discussion. The 
key fact for us is that, using perfect hashing [7], we can store the suffix tree for S in 0{n) 
space such that child and interval queries take 0{1) time. 

The 2-dimensional range counting problem is to store compactly a set of points in the 
plane such that, given a query rectangle, we can quickly count the points it contains. Follow- 
ing Bille and G0rtz, we use the following theorem; as they noted, combined naively with a 
suffix tree, this result can be used as an (9(r;,)-space, 0{m + log n/ log log + log log u)-time 
solution for substring range counting. 

Theorem 2 (JaJa, Mortensen and Shi |10] ). We can store n 2-dimensional points in 
0{n) space such that range counting queries take (9(logn/ loglogn) time. 

We use the next theorem simply to map the interval [a, h] to the subinterval of labels in [a, h\ 
that actually occur in S. Patra§cu |T1] showed that, if m = npolylog(n), then we can store 
a bitvector with any redundancy in n/polylog(n) that supports rank and select (and, thus, 
predecessor) queries in 0{1) time. 

Theorem 3 (Willard |16] and Patra§cu [14j). We can store n integers from [0,m] in 
0{n) space such that predecessor queries take 0{1) time if u = 'ripolylog(n) and 0{\og\ogu) 
time otherwise. 
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A rank query on S takes as arguments a character c and a position i and returns the number 
of occurrences of c in the prefix of S of length i. A select query takes c and a rank j and returns 
the position of the jth occurrence of c in S. Ferragina, Manzini, Makinen and Navarro [6] 
showed how to store S in compressed space such that these queries take 0(l + j^^^^^) time, 
where a is the alphabet size; this time bound is C(l) when a = polylog(n). 

Theorem 4 (Ferragina, Manzini, Makinen and Navarro [6]). We can store a string 
of n characters from an alphabet of size polylog(r2) in O^nloga) bits such that rank and 
select queries take 0{1) time. 

4 Data Structure 

Following Bille and G0rtz, we build a suffix tree and divide it into a top tree, consisting of all 
nodes whose string depths are at most log n/ log log n, and a forest of bottom trees, induced 
by the remaining nodes. We build a data structure for 2-dimensional range counting according 
to Theorem |2| storing a point {x,y) if and only if the first character in the lexicographically 
xth suffix is labelled If m > log n/ log log n we use the suffix tree to find the interval 
containing the lexicographic ranks of the suffixes starting with P, then we count the points 
in the product of that interval and [a,b], all in 0{m) time. Our solution differs in how we 
deal with the case when m < log n/ log log n. 

We sort the characters in S by their labels and store the resulting string Sr according to 
Theorem |4] at the root r of the suffix tree. Suppose a node v and one of its children v' both 
have string depth less than log n/ log log n; the edge from v to v' is labelled co a, where o 
denotes concatenation; and we store the string at v. Then we build a new string S^/ from 
Sy and store it at v'. To build 5'^,/, we discard all the characters of 5"^ not equal to c and 
replace each occurrence S[i] of c in by S[i + \a\ + 1] (or $ if z + |a| + 1 = + 1). We 
store all the strings at each depth in the suffix tree according to Theorem |4| which takes 
a total of (9((nlogcr)(logn/loglogn)) bits, where a is again the alphabet size. Assuming 
a = polylog(n), all the strings take a total of 0{n) space and rank queries take 0{1) time. 

Figure [l] shows the strings we store at the suffix tree's nodes when S = b|^ r^^ c^^ 
ag^ dy ag"^ bg'' r^Q af^, where characters' positions in S are shown as subscripts and their 
labels (pseudo-randomly chosen) are shown as superscripts. We have written the positions 
and labels in the figure to give insight into the construction, even though we do not actually 
store them. The string at the root consists of the characters of S sorted by label. To build 
the string at the root's third child, for example, we look at the edge from the root to that 
child and see its label begins with 'b' and has length 3; we find all the occurrences of 'b' in 
the root's string — i.e., h"^^ and bg^ — and replace them by the characters 3 positions later 
in — i.e., cp and $12. 

We build a predecessor data structure according to Theorem |3] and use it to store the 
characters' labels in S. We also store a partial-sum data structure for these labels' frequencies. 
Together, these data structures take 0{n) space and allow us to compute the interval in Sr 
containing characters with labels in [a, b], in 0{1) time if m = npolylog(n) and in 0{\oglogu) 
time otherwise. 
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Fig. 1. The strings we store at the suffix tree's nodes when S — af^ h?,^ 
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By induction, the characters in are the ones immediately following occurrences of 
str5(t;) in S] they are sorted by the labels of the first characters of those occurrences of 
str5(f). Suppose we know the interval in 5*^ containing characters immediately following in 
S occurrences of str5(f) whose first characters' labels are in [a,b]. Notice that the ranks of 
the first and last occurrences of c in that interval of S^, which we can find in 0{1) time, 
are the endpoints of the interval in S^' containing characters immediately following in S 
occurrences of str5(f') = str5'(t') o c o a whose first characters' labels are in [a, b]. Since the 
length of this interval in S^r is the number of such occurrences of str5(f), we can also count 
them in 0{1) time. 

If m < logn/ log log n then we descend from the root of the suffix tree to the locus of P, 
at each node v computing the interval in 5*^, containing characters immediately following in 
S occurrences of str5(f) whose first characters' labels are in [a,b]. When we reach the locus 
of P, we return the length of the interval. This takes a total of 0{m) time. 

Suppose 5" = af^ b^^ r3^ af' Cg^ ag^ d^ ag^ bg'^ r^Q a^f and we want to count the occur- 
rences of P = ab whose first characters' labels are in [20,40]. Using the predecessor and 
partial-sum data structure, we compute the interval [2, 6] in the string stored at the root 
in Figure [l| that contains the characters with labels in [20,40]. With two rank queries, we 
determine that this interval contains the string's first and second occurrences of 'a'. We de- 
scend along the edge labelled 'a' and consider the interval [1, 2] in the string stored at the 
child. With two more rank queries we determine there is only 1 'b' in that interval. Therefore, 
there is only one such occurrence of P in S*. 

Theorem 5. Suppose we are given a string S of n characters with integer labels in [0,u], 
over an alphabet of size polylog(n). We can store S in 0{n) space such that, given an interval 
[a,b] and pattern P of length m, we can count the occurrences of P whose first characters' 
labels are in [a, b] using 0{m) time if u = n polylog(n) and 0{m + log log m) time otherwise. 

We note as an aside that, climbing back up to the root and using a select query at each 
step, we can find the position in the string stored at the root of the first character in an 
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occurrence of P whose label is in [a, b], again in 0{m) time. We can store in 0{n) space the 
permutation that maps characters in 5*,. back to their positions in S, so we can return an 
example occurrence. For the case when m > log ra/ log log n, we store an (9(n)-space data 
structure for 2-dimensional range reporting [3] and use it to find a single example point; with 
the permutation, we then map that point back to a position in S. 

As we pointed out in Section [T| our solution for substring range counting immediately 
gives the same space and time bounds for substring range emptiness. By the reductions in 
Section |2| we also have the following theorem. 

Theorem 6. For strings over polylogarithmic alphabets, we can solve position-restricted sub- 
string counting and the counting versions of indexing with intervals, indexing with gaps and 
aligned pattern matching, all using space linear in the string length and query time linear in 
the pattern length. 
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